Skip to content

Conversation

@sullis
Copy link
Contributor

@sullis sullis commented Apr 24, 2024

AWS SDK for Java v2
CRT clients

https://docs.aws.amazon.com/sdk-for-java/latest/developer-guide/http-configuration-crt.html

From the AWS SDK docs:

The AWS CRT-based HTTP clients provide the following HTTP client benefits:

Faster SDK startup time
Smaller memory footprint
Reduced latency time
Connection health management
DNS load balancing

Amazon announced the CRT HTTP client in February 2023

https://aws.amazon.com/blogs/developer/announcing-availability-of-the-aws-crt-http-client-in-the-aws-sdk-for-java-2-x/

@sullis sullis changed the title AWS: Add AWS crt client AWS: Add AWS crt client support Apr 24, 2024
@sullis sullis force-pushed the sean/aws-crt branch 2 times, most recently from d12c649 to c8ec7d1 Compare April 24, 2024 21:14
@github-actions github-actions bot added the docs label Apr 24, 2024
@sullis sullis marked this pull request as ready for review April 24, 2024 22:41
@sullis
Copy link
Contributor Author

sullis commented Apr 24, 2024

Ready for review

@nastra
Copy link
Contributor

nastra commented Apr 26, 2024

AWS CRT-based HTTP clients do not use the aws-c-s3 library and do not support the S3 multipart upload API features.

I think this might be an issue if multipart uploads aren't supported

@sullis
Copy link
Contributor Author

sullis commented May 3, 2024

I am planning to continue working on this PR next week. I'll add an update when I have time.

@sullis sullis force-pushed the sean/aws-crt branch 2 times, most recently from 2190f8e to db32a28 Compare November 2, 2024 18:23
@sullis
Copy link
Contributor Author

sullis commented Nov 2, 2024

I am resuming work on this PR.

@github-actions
Copy link

github-actions bot commented Dec 6, 2024

This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the [email protected] list. Thank you for your contributions.

@github-actions github-actions bot added the stale label Dec 6, 2024
@github-actions
Copy link

This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

@github-actions github-actions bot closed this Dec 13, 2024
@sullis
Copy link
Contributor Author

sullis commented Apr 7, 2025

for posterity:

Apache Iceberg Java main branch has support for AWS S3 CRT

https://github.com/apache/iceberg/blob/main/aws/src/main/java/org/apache/iceberg/aws/s3/DefaultS3FileIOAwsClientFactory.java

image

The AWS SDK S3 crtBuilder was added in this pull request:

#12299

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants